Global 3d Planar Reconstruction with Uncalibrated Cameras and Rectiied Stereo Geometry

This article presents a seldom studied 3D reconstruction approach, and focus on its numerous advantages. It is a global approach, in which the algorithm attempts to reconstruct geometric high level features by using only global attributes of the image projections of the feature. Our elementary feature is a 3D planar patch, and geometric moments are the global attributes. The proposed method of reconstruction has the following advantages: the use of the geometric moments of image region does not require a pixel-to-pixel matching and yields robustness to small errors of segmentation on region edges, the rectiied stereo geometry constraint allows reconstruction with uncalibrated or calibrated cameras when epipolar geometry is known, valid matched regions are selected and thus the probably occluded planar patches are not reconstructed, interpolation of views between the left and right cameras can be performed to produce synthetic intermediate views of the observed scene. Experiments on real and synthetic stereograms are presented to illustrate the advantages of the approach.